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Abstract. We study continuous time Markov processes on graphs. The notion 
of frequency is introduced, which serves well as a scaling factor between any 
Markov time of a continuous time Markov process and that of its jump chain. 
As an application, we study "multi-person simple random walks" on a graph G 
with n vertices. There are n persons distributed randomly at the vertices of G. 
In each step of this discrete time Markov process, we randomly pick up a person 
and move it to a random adjacent vertex. We give estimate on the expected 
number of steps for these n persons to meet all together at a specific vertex, 
given that they arc at different vertices at the begininng. For regular graphs, 
our estimate is exact. 



1. Introduction 

In this paper, for simplicity, we will consider connected simple graphs only. 
These are connected graphs without multiple edges and loops. We will adopt the 
following notations and terminologies for a graph G. The sets of vertices and edges 
of G are V(G) and E(G), respectively. The order n of G is the number of vertices 
of G, and the size m of G is the number of edges of G. Thus, n = \V(G)\ and 
m = \E(G)\. For a vertex x G V(G), T(x) is the set of vertices which are connected 
to x by an edge in E{G). The degree of a vertex x is d(x) = \T(x)\. We have 

d(x) = 2m. 

xdV{G) 

The adjacent matrix of G is denote by A(G) and the diagonal matrix D(G) has 
the sequence of degrees at each vertex as its diagonal entries. Finally, we denote 

d m = min {d(x) ; x G V(G)} and du = ma.x{d(x) ; x G V(G)}. 



What concerns us primarily in this paper is the following continuous time Markov 
process on a graph G: The probability that a person standing at a vertex x of G to 
jump to a neighboring vertex in T(x) within a time period At is d(x)At+o(At), and 
once jumped, the person at x has equal probability to land at a vertex y G T(x). 
If we write 

Q = Q{G) = -D{G) + A(G), 
the transition probability matrix of this Markov process is 

P(t) = e tQ . 
l 
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We call this Markov process CTSRW (continuous time simple random walks). In 
the literature, it is the discrete time simple random walks (SRW) on a graph G 
that people concern most. One usually call SRW the jump chain of CTSRW. The 
transition probability matrix of SRW is D(G)~ 1 A(G). 

We introduce in this paper a fundamental quantity for CTSRW on a graph G 
called frequency. Let N(t) be the expected number of jumps of the Markov process 
CTSRW up to time t. Then the frequency / of CTSRW is defined to be 

t^oo t 

Using the Levy formula, we are able to calculate the frequency for CTSRW and 

get 

*» 

n 

The frequency turns out to be a natural scaling factor between various important 
quantities of CTSRW and SRW, respectively. For example, we have the following 
theorem. 

Theorem 1.1. Let G be non-bipartite. For a vertex x of G, let T x be the first 
return time of CTSRW on G and Nt x be the number of jumps during the time 
period [0,TJ. Notice that Nt x is the first return time for the discrete time SRW. 
Then, the expectations ofT x and N Tx , E{T X ) and E{N Tx ), respectively, are related 
by the following equation: 

E(N Tx ) = fE(T x ). 

More generally, we have the following theorem. 

Theorem 1.2. Let T be any Markov time (or stopping time) of CTSRW on a 
graph G with finite expectation, let N T be the number of jumps during the time 
period [0, T]. Then 

d m < f <d M 

and 

d m E(T) < E(N T ) < d M E(T). 
In particular, if G is regular so that d m = du, we have E(Nt) = fE(T). 

As an application, we consider multi-person simple random walks (MPSRW) on 
a graph G. To start with, we assume that each of the n vertices of G is occupied by 
a person. In each step of this Markov chain, there is one person, equally possible for 
each of these n persons, who moves to a neighboring vertex, also equally possible 
for each of the neighboring vertices. We would like to know the expected number 
of steps this Markov chain should take for these n persons to meet all together at 
a specified vertex. 

We will see that this Markov chain is the jump chain of a continuous time 
Markov process on the set M n of maps from {1,2, ... ,n} to itself. On the other 
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hand, this continuous time Markov process on M n can be identified with the n- 
th tensor power of CTSRW on G. Thus, computation of expectations of various 
stopping times for this continuous time Markov process on M n can be carried out. 
We are then able to use Theorem 1.2 mentioned above to obtain estimates for the 
expected number of steps for MPSRW on G to coalesce. 

We refer the reader to [21 El El for basic terminologies and results in the study 
of simple random walks on graphs. 

2. Continuous time Markov process on weighted graphs 

Let G be a connected weighted graph with order n size m, we define continuous 
time Markov process X t on G by giving its infinitesimal generator Q as the negative 
weighted Laplacian of G. Specifically, every edge xy G E{G) is associated with a 
positive number (weight) w xy . We do not direct edges in G and therefore w xy = 
w yx . We denote by 

w x = ^2 w xy 

the total weight at the vertex x. We write Q = (q X y) nxn , where 

{w xy if xy G E(G), 
-w x i£x = y, 
otherwise. 

Thus the probability transition matrix X t is given by 

P(t) = e^ = (p xy (t)) nxn , 

and transition probability from vertex x to vertex y is given by 

Pr {X (h + t) = y | X (h) = x}= p xy (t) . 

By the way, we may call — Q = L w the weighted Laplacian of the weighted graph 
G. 

In the special case of w xy = 1 for all xy G E(G), we have CTSRW on the graph 
G. The infinitesimal generator Q = —L{G) = —D{G) + A(G) = (q xy ) n xn is given 
by 

{1 if xyeE(G), 

-d(x) i£x = y, 
otherwise. 

2.1. Ergodicity. We set u = (-,-,••• , -) to be a probability vector. Then, since 
Q is symmetric, u is an invariant measure of the Markov process X t . Namely, we 
have uQ = and 

uP (t) =u(l + tQ + l -Q 2 + ■ ■ ■ \ = u. 
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We claim that u also is the ergodic vector or the stationary distribution. To see 
this, notice first that the graph G is connected so the process X t is irreducible. 
Thus 

lim p xy (t) = v y 

t — >oo 

exists and does not depend on x. Actually, we have v y = u y = ^ by the following 
calculation: First, for any fixed t > 0, 

uP{2t) = uP (t) P (t) = uP (t) = u, 
uP (kt) = uP ((k - 1) t) = ■ ■ ■ = uP{t) = u. 

Then 

u v = ^2 UxPx y fit) , for y E V (G) . 

X 

Let k — > oo, we get 

E 



Uy y U X Vy Vy. 



2.2. The mean first return time. For a vertex x G V(G), denote by T xx the 
first return time to x, given that the Markov process X t starts at x. That is 

T xx = inf {t : t > p x , X t = x \ X = x} 

where p x is the exit time from the vertex x. We denote by h(x, x) the mean first 
return time E(T XX ). 

Lemma 2.1. The mean first return time is 

h(x, x) = — . 

Proof. Write 

Pxx 

(t) = Pr {T xx <t}. 

Then we have the equation [3] 



Pxx = e Wxt + / Vxx (t - s) dF xx (s) . 
Jo 
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Taking Laplace transform, we get 

POO 

<Pxx (A) = / e~ xt p xx (t) dt 
Jo 

poo poo pt 

= / e - (x+w ^dt+ / e~ xt / p xx {t-s)dF xx (s)dt 
Jo Jo Jo 



A + 
1 



+ / / e- xt p xx (t-s)dtdF xx (s) 

~ U! x J J s 



A + w 



noo 
e- X{v+s) p xx (v) dvdF xx (s) 



A + 
1 



poo POO 

+ / e- Xs / e- Xv p xx (v) dvdF xx (s) 

- w x J Jo 

POO 

+ / e- Xs <p xx (\)dF xx (s) 
Jo 

+ 4>xx (A) l x (A) 



\ + W x ,/ 

1 



A + w 

where l x (A) = f Q °° e~ Xs dF xx (s). Then, we have 

1 fl-l x (X)y 1 



Hxx (A) 



\ + d(x)\ A 



Since 



and 



I — I (X) f°° f°° 

lim ^ = lim / se~ Xs dF xx (s) = lim / sdF xx (s) = h (x,x) 

a^o A a^o J Q \-^o Jq 



we get 



lim \<p xx (A) = u 2 

A — >0 



i fi-i x (\)y 1 

u-r = lim 



a^o A + w x \ A 
1 



Thus, 



h (x, x) d (x) 



h(x, x) = — 
w x 



2.3. The mean hitting time of y from x. In general, define 

T xy = inf {t : t > p x , X t = y \ X = x}. 



□ 
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I. e. T xy is the time of first entrance into, or hitting, the vertex y, given that 
the process starts at x. We denote the mean first hitting time of y from x by 
h (x,y) = E(T xy ). We have the following equation: 

h(x,x) = — + Y] —^-h(y,x) = — + — Y] w xy h(y,x). 

w x w x w x w x 

y er(x) x xx y( _ r(x) 

Lemma 2.2. The mean hitting time can be calculated from the following integral: 

poo 

h(x, y) =n (p yy (t) - p xy (t)) dt. 
Jo 

The formula in this lemma is similar to the formula in the discrete time case. 
We omit the proof since it is also analogous to the discrete time case. 

2.4. The stationary distribution of SRW. For an unweighted graph G, the 
jump chain CTSRW on G is SRW on G. We know that Q = -D + A, and the 
transition probability matrix of SRW is D~ l A. If we set 7r = uD, where u is the 
stationary distribution of CTSRW, then uQ = —uD + uA = 0. So, substitute 
u = 1\D~ X we have 

7? = ZD' 1 A. 

Thus, 7r is an invariant measure of SRW. We need to normalize it. Let 

1 

7T = — 7T. 

Then tt is an invariant distribution for SRW. Specifically 

d (x) d(x) 
E xe v(G) d ( x ) 2m ' 



If the graph G is non-bipartite, this invariant distribution is also the stationary 
distribution. It is well known that the mean number of steps SRW should take 
to return to the vertex x for the first time is l/ir x = 2m/d(x). Recall that the 
mean first return time of CTSRW is n/d(x). Therefore it is natural to think of the 
quantity 

2m/d{x) 2m 
n/d{x) n 

as the frequency (number of jumps per unit time) of CTSRW. We will make this 
notion precise in the following subsection. 

2.5. The frequency. To define the frequency for the continuous time Markov 
process X t on a weighted graph, we first define a quantity N(t) for t > 0: 

N (t) = E (the number of jumps of X t up to time t) . 
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Theorem 2.1. We have 

t^oo t n 

where w is the total weight of G 

xydE{G) 

Proof. Let us recall the Levy formula first. See Given a Markov process X t , 
we consider a purely discontinuous functional A = {A t : < t < oo} on the path 
space defined by 

A= g(x s -,x s ), t>o, 

0<s<t 

where g is a function on V{G) x V{G). Also, we define a function 6q on V{G) by 

b Q ( x ) = w *y9 0, V) , xeV(G), 

and the integral functional B = {B t : < t < oo} on the path space is defined by 
B t = b Q (X s ) ds= Y w x s . y 9 (X a , y) ds. 

Then, the relationship between the functionals A and B is given by the Levy 
formula: 

E x J2g (X s - , X s ) a (t) = E x j a (t) b Q (X s ) ds, t > 0, 

0<s<t ^° 

for any continuous positive function a (t) . 

Now, taking a (i) = 1, the Levy formula tells us 

-t 



E x A t = E x B t = [ P(s)-b Q (x)ds. 
Jo 



Furthermore, let 

q(x ) = { 1. if 
9{x, y) | o, if x = y. 

Then A t is the number of transitions of states of X t up to time t, i. e. EA t = N (t). 

We start at the vertex x. Then 

E x A t = P(s) -b Q (x) ds = V] Vxy (s) w y ds. 

Jo Jo yeV(G) 

If we start at an initial distribution 9 on graph G, then 

E e A t = 6P (s) ■ b Q ds = j 6 x p xy (s) w y ds. 
Jo Jo „ „, 



x.y 
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Thus, we have 





x,y y 

and it is independent of the initial condition 6. So, 




□ 



Using the notion of frequency, we can compare various Markov times for the 
continuous time Markov process and its jump chain. Let us recall the notion of 
Markov time (or stopping time) first. Associated with a stochastic process, there 
are random variables independent of the future. This kind of random variables are 
called Markov time or stopping time. Specifically, let a be a non-negative random 
variable associated with a given process {X t : < t < oo}. In the other words, a 
associates with each sample function X t a nonnegative number which we denote 
by a (X t ). Such a random variable a is said to be a Markov time relative to the 
process X t if it has the following property: 

If X t and Y t are two sample functions of the process such that X T = Y T for 
< t < s and a (X t ) < s, then a (X t ) = a (Y t ). 

Now, let's state our main result. 

Theorem 2.2. Let T be any Markov time with finite expectation, i.e. E{T) < oo 
associated with the continuous Markov process X t on a weighted graph G. Let Nt 
be the number of jumps of X t during the period [0, T]. Then, we have 




w m E(T) < E(N T ) < w M E (T) , 
where w m = min {w x ; x G V(G)} and wm = max {w x ; x G V{G)}. 

Proof. By the Levy formula, for an initial distribution 6, we have 




x,yev(G) 



Since 




x,y&V{G) 



x,yeV(G) 



MARKOV PROCESSES ON GRAPHS 9 

and 

^ OxPxy (s) W y > ^ ®xVxy («) W m = W m , 
x,y&V(G) x,y&V(G) 

we get 

w m t < N(t) < wut- 

This is 

Nit) 

Wm < ^ W M- 

By taking limit, we have 

w m < f < w M . 

We suppose that Markov time T has distribution F(t) = Pr {T < t}. Then we 
have 

oo rco »r/j\ poo 



w m tdF < ! ^^-tdF < I w M tdF. 



^0 



Jo 



This actually is 



/»oo poo /»oo 

w m / tdF < N(t)dF <w M tdF. 
Jo Jo Jo 

We recall the conditional expectation 

POD 

E{N T ) = E{E{A T \T = t)) = N(t)dF. 

Jo 

Therefore, we get 



w m E{T) < E{N T ) < w M E (T) . 



□ 



The following are two interesting corollaries. The proofs of them are obvious, so 
we just state the results. 

Corollary 2.1. For CTSRW on a graph G and any Markov time T with finite 
expectation, we have 

d m < f < d M 

and 

d m E(T) < E(N T ) < d M E(T). 

Corollary 2.2. If G is a regular graph with constant degree d at each vertex, then 
f = d and E(N T ) = fE(T) for any Markov time T associated with CTSRW on G. 

We may call the inequality in Theorem 2.3 and Corollary 2.1 "time-step inequal- 
ity" . Of course, we have another version as 

EiM < E(T) < ^M. 

dM d m 
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In a sense, those inequalities characterize the timing difference between CTSRW 
and SRW on a graph. It is also interesting to see that the frequency of an un- 
weighted graph is the average of the eigenvalues of its Laplacian. Let Ai < 
A2 < A3 < • • ■ < A n be the spectrum of the Laplacian L(G) of a graph G, 
L{G) = D (G) — A(G). Then, £™ =1 A, = £* e y (G) d (x) = 2m. Thus 

n 

Theorem 2.3. Let G be a non-bipartite graph, and T x be the first return time of 
CTSRW on G. Then E{N Tx ) — fE(T x ). 

Proof. By the theory of discrete time simple random walks on a graph G, we know 

2m 



For CTSRW on G, we know E{T X ) = ^y, and also / = Thus 



□ 



Now, we consider a special problem as that in SRW. Let G be a connected non- 
bipartite graph. We start our CTSRW at a vertex x and fix a neighboring vertex 
y of x. What is the expected time that our CTSRW should take in order to return 
to x through the edge yxl 

For SRW on G, we know the corresponding quantity, the expected number of 
steps one should take in order to return to x through the edge yx, is 2m [Bollobas'] . 

To deal with the problem for CTSRW on G, we formulate the following Markov 
time: 

T( x ,yx) = inf {* + Py '■ t > °> X ( s + *) = Vi X ( s + t + Py) = x I X ( s ) = x ) ■ 
This is the fixed edge first return time, then E(Nt (xW) ) = 2m. By our time-step 
inequality, we have the following corollary. 

Corollary 2.3. The mean fixed edge first return time has bounds as 

The following is another case where the frequency gives us a perfect scaling 
factor between corresponding quantities of CTSRW and SRW, respectively. 

Lemma 2.3. Let G be a connected graph of order n and size m. The mean hitting 
time h (x, y) of the CTSRW on G satisfy 

xev(G) yer( x ) 
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Proof. We know 

hM = W) + ah ^ h ^ x) = wr 

yer(x) 

So, we have Y^ y er(x) > x ) = n — 1 which is independent of x. Thus, for n vertices, 
we will have 

□ 

If we denote the hitting time of y from x in SRW by H(x,y), then we have an 
equality 

J2 J2 H(y,x) = 2m(n-1). 
ieV(G) yer(x) 
See So, we have the following theorem. 

Theorem 2.4. With notations as the above, we have 

£ H(y,x) = f E /l ^ a; )- 

Also, for CTSRW on a graph G, we define the mean commute time between 
vertices x and y to be c(x, y) = h(x, y) + h(y, x). Let C(x, y) be the corresponding 
quantity for SRW on G. Then we have another version of the above equation in 
Theorem 2.4 as 

xyeE(G) xy£E(G) 

3. Multi-person simple random walks on graphs 

We are led to the multi-person simple random walks (MPSRW) on a graph G 
by the study of a continuous time Markov process induced by CTSRW on G. The 
combinatorics of MPSRW is much richer than we have touched upon here. 

Let I n be a finite set of cardinality n. For example, we may have J n = {1, 2, . . . , n}. 
We denote the set of all maps from I n to itself by M n . We have the symmetric 
group S n sitting inside of M n . A map x G M n is called a generalized permutation 
of deficiency k if 

| a; =n-k. 

We denote def(x) = k. 

M n is a semigroup under composition. The symmetrical group S n is a subgroup 
of M n . The deficiency determines a grading on M n which is compatible with the 
semigroup product on M n : 

def (x) + def (y) > def (x o y) . 
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Denote = {all maps with deficiency k} , then we have a decomposition of 

M n according the deficiency: 

M n = M( 0) II M« II M< 2) H • • • II M^ n ~ l \ 

11 It lb 1 1 ' 

where M,l 0) = S n . 

Let G be a graph with the set of vertices V(G) identified with I n . We will call 
G the ground graph. Let the adjacency matrix A (G) = (a^) x with entries given 
by 

_fl if ij G E (G), 
I otherwise. 

We define a new graph M (G) as follows: The set of vertices of M (G) is M n ; 
For x, y G M n , there is an edge xy in M (G) only when 

\{i:x(i)j:y(i)}\ = l, 

and if xii) ^ y (i) , then a x (i) y (i) = 1. We will see that there is a close relationship 
between the graph M (G) and the n-th tensor power of CTSRW on the ground 
graph G. 

3.1. The tensor product of Markov processes. Let x[ l \ x[ 2 \ ...,X^ be 
Markov processes on the state spaces S^ 1 ), S^ 2 \ . . . , respectively. We define 
a new process Y t on the state space x x • • • x with the transition 
probability given by 

Pr {Y t+h = (s 2 ) | Y h = ( Sl )} 

= n ft { 1 ^ = 4 t> iii" = «? > } 

fc=l 

where (s,) = (s J - 1 ' ) ) s ! 2 \ • • • > s !™' > ) > * = 1> 2, and (fe) (t) is the transition proba- 
bility of the Markov process x[ k \ k — 1, 2, . . . , n. 

(k) 

We call Y t the tensor product of Markov processes , k = 1, 2, • • • , n. 

The next two lemmas can be proved by some direct computations. So we omit 
the proofs. 

Lemma 3.1. Y t is a Markov process. 



MARKOV PROCESSES ON GRAPHS 13 

Lemma 3.2. Let q( Sl )( S2 ) t> e the infinitesmal generator ofY t . Then 

q^h (k) if 3 only one index k such that ^ 

9(ai)(a 2 ) = { ELi 9% (*) */ ( s = ( s 2), namely, s[ k) = s {k) for all k, 

s 1 s 2 

otherwise, 
where {k) is the infinitesmal generator of Markov process x\ k \ k = 1,2, ... ,n. 

Now, if we order the elements of the state space S^ 1 ) x S^ 2 ) x • • • x lexico- 
graphically, it is easy to see that the probability transition matrix of Y t is given by 
the tensor product 

P« (t) <g) P( 2 ) (t) <g> • • • <g> ?W (t) . 

This is why we call Y t is the tensor product of Markov process X^ (t) , k = 
l,2,...,n. By one of the lemmas above, we also can see that the infinitesimal 
generator matrix of Y t is given by 

Q {1) + Q {2) <g> J <g> • • • <g> J + + I <g> • • • <g> I <g> Q (n) 

where is the infinitesimal generator matrix of x[ k \ k = 1, 2, ... n. Thus, for 
convenience, we denote Y t = X^ ® xj® <%>■■■<%) x[ n \ 

3.2. CTSRW on M(G). On the graph M(G), we have the Markov process CT- 
SRW. Denote it by Y t . Let X t be the Markov process CTSRW on G. 

Lemma 3.3. The Markov process Y t on the graph M{G) is the n-th tensor power 
of the Markov process X t on the ground graph G. The jump chain of Y t is MPSRW 
ofG. 

Proof. Let's recall Q = -L (G) = -D (G) +A(G) = {q tJ ) nxn , 

1 iiijeE(G), 
qij = <( -d(i) if i = j, 

otherwise, 

where d (i) is the degree of the vertex %. Let X t <g> X t <g> • • • ® X t = Z t be the 
n-th tensor power of the process X t . Take two states for Z t , (si) and (s 2 )- Then 
(sj) actually is a sequence of vertices of G. We write (si) = (ii, ii, . . . ,i n ) and 
( s 2) = (ji, 3ii ■ ■ ■ i jn) ■ By the lemma above, we have 

5^2) (fc) ^ 3 only one index k such that ^ 

P{ S1 )( S2 ) (°) = { ELi if ( s i) = ( s 2), namely, s[ k) = s (k) for all k, 



2 



otherwise 

1 if 3 only one index k such that ik ^ jk, ikjk £ -E (G), 

■ Y2=i d if ^ = ifc for a11 

otherwise. 
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Now, we can identify (si) and (s 2 ) with the images of certain maps x and y, 
respectively. Then by the definition of M(G), xy G E (M (G)) , if and only if 
P( S1 )( S2 )(0) = 1. As to the degree of x, we know that the neighbors of x — (si) can 
only be (ki,i 2 , . . . , i n ), where k\ must be a neighbor of i\\ k 2 , ■ ■ ■ , i n ) , where k 2 
must be a neighbor of i 2 ; and so on, up to the last one (ii,i 2 , ■ ■ ■ , i n -i, k n ) , where 
k n must be a neighbor of i n . Thus 

n 

= d(si) = J^dfo) • 
j'=i 

This agree with p' (si)(si) (0) = - ELi rf (**) ■ So - 3^ = X t ® X t (8) • • • ® X t = Z t . 
The second conclusion is easy to see. □ 

Because of this lemma, we may call graph M(G) the tensor power of the graph 
G. We also note that the transition probability from x to y in M n is given by 

n 

Pxy it) = Y[p x (i)y(i) (t) ■ 

i=l 

From the proof of Lemma 3.3, we know that for x G M n = V(M(G)), 

n 

d(x) = J2d(x(k)). 

k=l 

We can compute the size of M (G), i. e. the number of edges of M(G) as 

n n 

xeM n x£M n k=l k=l xeM„ 

n 

= ^((rf(l) + rf(2) + --- + rf(n))n"- 1 ) 

k=i 
= 2mn n . 

Thus, the size of M(G) is mn n . It is clear that the order of M(G) is n n . Therefore, 
the frequency of M(G) is 2m. 

Lemma 3.4. G is bipartite if and only if M (G) is bipartite. 

Proof. We use the classical result of Konig that a graph is bipartite if and only if 
all its cycles are even. 

If G is not bipartite, then there is a cycle C = V\V 2 • ■ ■ v m V\ of odd length in G. 
We look at the cycle in M (G) given by 

(V 1: V U ■ ■ ■ , Vx) • • • , Vi, V 2 ) (Ui, • • • , Ui, V 3 ) • ■ ■ (Ui, • • • , Vi, V m ) (V 1: ■ ■ ■ , Vi,Vx) . 

Its length is also odd. Thus M(G) is not bipartite. 

If G is bipartite, then the set of vertices V = V(G) can be written as V\ U V 2 , 
with V\ fl V 2 — and there is no edge between vertices both in V\ or both in V 2 . 
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We try to bipart the set of vertices of M(G). We know V(M(G)) = V xn . We write 
V = V 1 + V 2 . Then 

v xn = (Vt u v 2 ) xn == v[ l u v[ l - x v 2 u v?~ 2 vi u • • • u v 1 v 2 n - 1 U V 2 n , 

where V™~ k V 2 k means we take (n — k) vertices from V\ and k vertices from V 2 , 
regardless of order, to form a vertex of M{G). Let 

v[ = v^u vr 2 vf U V[ l ~ % 4 u • • • , 
V 2 = v?~ x v 2 u v^vi u v?v?- 5 u • • • . 

Then % U V 2 = V(M(G)) and V^f] V 2 = 0. By the definition of M(G), we can not 
find an edge between any two vertices which are both in V\ or both in V 2 . □ 

If G is not bipartite with order n and size m. Write the degree sequence of G 
as d\ < d 2 < • • • < d n . For any vertex x in M(G), the x-component of the ergodic 
vector for SRW on M(G) is given by 



d ( x ) = T,?=id(x (i)) = n „ n y- djx (i )) 
2mn n 2mn n 2m 



^ djxji)) _ G 

i=i i=i 



where 



7T G 



d(x (i)) 



2m 

is the x (i) -component of the ergodic vector for SRW on G. 

The expected first return time for CTSRW on M(G) is given by 



h(x, x) 



d(x) £]U <*(*(*))' 

In particular, for the identity map Id, d(Id) — d± + d 2 + • • • + d n — 2m. So 

For the jump chain SRW on M(G), or MPSRW on G, we have 

H(x,x) = f M (G)h(x,x) = = — 

E fc =i d(x{k)) 

where /m(G) — 2m is the frequency of M(G). In particular, 

H {Id, Id) = n n . 
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3.3. Hitting time for CTSRW on M(G). For CTSRW on M(G), we are in- 
terested in calculating h(Id,Ci), where q is the constant map to a vertex i of G. 
Once we know h(Id,i), we can use it to estimate H(Id,Ci) for SRW on M(G), or 
equivalently, the expect number of steps MPSRW on G should take to have all 
persons meet at the vertex i. Namely, we have 

ndih(Id,Ci) < H(Id,Ci) < nd n h(Id,Ci). 

Notice that when the graph G is regular, H(Id, q) is determined completely by 
h(Id,Ci): H(Id,Ci) = nd-h(Id,Ci). 

Let x and y be two distinct vertices in M{G), we consider the hitting time h(x, y) 
of y from x in CTSRW. We have 



poo 

h(x,y) = n n / (P yy (t)-P xy (t))dt 
Jo 

POO I n n 

= Tl n T\Py(i)y(i) (t) ~ T\Px(t)y(i) (*) I dt. 

J ° \i=l i=l 

For x = Id, y = Ci, we have 

/oo I n \ 

[Pn(t) n -\[p 3l (t)\dt. 



To calculate this integral, we diagonalize the Laplacian of G. Write 
f/ T gf/ = diag[-A 1 ,-A 2 ,-- - ,-A„], 
where U = (ui,-)„ v „ is an orthogonal matrix. Then 



Pij (0 = E U ik U jkd~ 



k=l 

Since 



\fe=l / l<fci,fe2,--- ,k„<n 

and 

n 

n^( t )= E u lkl u ikl u 2 k 2 Ui k2 ■ ■ •w„fc n Wifc„e~( Afc i +Afc 2 + "' +Afc '0*, 

fc=l l<fci,fc2,--- ,k n <n 

we get 

2 2 2 

h(Idc) — n n ^2 ' ' ' "' / ' V ~ "2/,- 2 "/7,-2 • ' • "»a„ "'/.-, 
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Example. Let G be the triangle graph. It is regular with n = 3 and d = 2. The 
matrix Q and U are given below: 



Q= 1 -2 1 and (/ 





We have U T QU = diag[— 3, — 3, 0]. Since A 3 = 0, when calculating h(Id,Ci), we 
should drop the term (ki, ki, k 3 ) = (3, 3, 3). Notice that the numerator of this term 
in h(Id, q) is also zero, so it is fine to drop this term. We have 

So 

H(Id,a) =3-2- — = 31. 

Thus, for our MPSRW on the triangle graph, it takes 31 steps on average for 
3 persons to meet at any specified vertex, given that they all start at different 
vertices. 

For the square graph with n = 4 and d — 2, a similar calculation shows 

h(Id,d) = 4" 167 1336 



1120 35 
and 

ci) = 8 • — — w 305.371. 

Thus, for our MPSRW on the square graph, it takes about 305 steps on average 
for 4 persons to meet at any specified vertex, given that they all start at different 
vertices. 
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